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authorized, prepared, and submitted to the Government __ 



Descriptive Title of Invention: 
Network Attached Graphics Ada 
Name of Project 
Scalable Computing Systems 
Product Name or Number 
1VA (Internet Visualization Architecture) 
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Was a product including the invention announced, offered for sale, sold, or is such activity proposed? If so, the date(s) and location(s): 
Redacted 

Was the invention disclosed to anyone outside of HP, or will such disclosure occur? If so, the date(s) and name(s): 
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Was the invention described in a lab book or other record? If so, please identify (l ab book #, etc.) 
Was the invention built or tested? If so, the date: 
Redacted 

Was this invention made under a government contract? If so, the agency and contract number. 

Redacted — — — 

Description of Invention: Pfease preserve all records of the invention and attach atMHonar pages for the following, tacn aoomonaf page should 

*' '* be signed and dated by the inventors) and witnesses). ^ 

A. Description of the construction and operation of the invention (include appropriate schematic, block, & t>m.ng diagrams; drawings, samples, 

graphs; flowcharts; computer listings; test results; etc.) 
B Advantages of the invention over what has been done before. 
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"thin clients" or "appliances". 

Current display refresh on the graphics adapter works as follows: 

While (TRUE) 

If start of vertical retrace 

For all pixels in frame-buffer 

Read pixel from frame-buffer 
Convert pixel to output format 
Transmit out analog/digital port 

The functionality listed above would be replaced with the following: 

While (TRUE) . , Jt . u a 

If new update is requested a time threshold has been reached 

If there has been a change in some portion of the frame-butler 
If compression of the frame-buffer enabled 

.o interne. Protocol (IP) or Cher network protoeo! 
Transmit the compressed frame-buffer out the network interface. 

ElSC Convert the frame-buffer to IP or other network protocol 

Transmit the uncompressed frame-buffer out the network interface port. 

Th. alsorithm listed above could be combined with algorithms presented in the invention disclosure titled 
%SX^^ redundant data * m " Visualization Appuance" which involved imposing a 
tiling on the image and keeping track of the tiles that have been modified. 

functionality. 

While (TRUE) _ . . 

If new uodate is requested a time threshold has been reached 

If new update! Mjq^ ^ ^ ^ rf ^ ^ or overlay planes 
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If compression is enabled . 

Coalesce and compress the buffer resulting from the primary and overlay planes 

And cursor location. 

Convert the compressed buffer to Internet Protocol (IP) or other network protocol 
Transmit the compressed frame-buffer out the network interface. 



Else 



Convert the coalesced buffer to IP or other network protocol 
Transmit the uncompressed buffer out the network interface port. 



The operation of coalescing involves reading the pixel from the higher priority buffer or determining the buffer 
that has precedence and performing color LUT conversions and also merging m the cursor. 

One of the disadvantages of current display refresh technology is that the data that is sent out the frame-buffer is 
not tagged to allow delivery of the frame-buffer contents to multiple destinations Consequently, graphics 
adaPtX £e uLlly not med in "server" like environments where multiple users share a single machine^ As a 
!SdtaS l^e Citrix Metaframe are used that send the graphics protocol over the network which must 
be rendered by the client. 

There have been graphics cards created with multiple video output ports. With these types of video cards it 
nS be possible to have one user using one region of the frame-buffer and another user using another region 
oflhe framlbuffer. It may also be possible to load a computer with more than one graphics adapters and have a 
one-to-one mapping between users and graphics adapters. However, the number of physical ports on the 
graphics adapter and number of graphics cards in the system limits these approaches. 

Using this invention it becomes possible for multiple users/clients to share or time-slice a graphics card and 
have thel oZ unique session and/or desktop. Given a graphics adapter with it's own video memory associate a 
unique region of the graphics adapter memory with each unique network device. For example jtfamjKS 
adapter hS 32 Mbytes of memory the first 4 Mbytes might be assigned to network device 1 the second 4 
Mbytes may be assigned to network device 2, and so on. The algorithm listed below would then be used to 
update each network-attached device: 

( If^update is requested by a specific network device or a time threshold has been reached 
If the frame-buffer for the specific network device has been modified 

Configure the frame-buffer compression engine to compress the frame-buffer 

for the network device. 
Compress the frame-buffer for the network device. 

Convert to IP . 
Configure the network interface unit to send the compressed frame-buffer to the 

network device. 

Transmit the compressed frame-buffer to the network device out the network 
Interface port. 

Another possible use of this invention is in the area of collaboration where multiple users share a common 
Stop or Sow within a frame-buffer. In this scenario the same frame-buffer or same region of the frame- 
buffer would be compressed and transmitted to multiple network-attached devices. 
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Advantages over Prior Art 

. Off-loads the compression, read back, and transmittal of the frame-buffer from the host system or CPU. 
Current to Ser an Sage rendered in a graphics adapter to a remote network attached de.ce the 
frame-buffer would be required to be read back from the graphics card into system memory, 
^pressed* Z sent ove'r the host system's network interface. Alternative*, a ™^«J*£™ 
ZZ be used as identified in the invention disclosure called "Internet ^Graphics Apphance . However, 
this invention has additional benefits beyond the IGA approach, which are hsted below 
. Transmittal of the contents of the frame-buffer only occurs when the contents of the frame-butter 
SZTcuim* graphics adapters transmit the entire contents of the frame-buffer to the monitor at a 
foSous "fresh rate independent of whether or not any pixels within the ^"^ed 
k value This is necessary because monitors and other display devices do not have their own local 
SJSUas a result, the overhead of display refresh imposes a constant drainc *r the 
^phics adapters memory sub-system, which significantly impacts graphics rendering performance 
S the same memory is being accessed by the rendering engine and display refresh ^umt This 
Mention decouples the actual display device refresh from the graphics adapter which could 1 free up 
Scant memory bandwidth when actual frame-buffer image updates are occurring less often than the 
r S rate of the display device. It is noted that if a network fabric such as Ethernet were used for 
Slav refresh, the capability presented here would be dependent on the remote network attached 
monho or d isplay dele to be able to persist the transmitted frame-buffer in its own local 
S refresh from a local memory source. Currently this technology does not exist and this is the subject of 
another invention disclosure that is in the process of being submitted. 
. TrammittaTof the contents of the frame-buffer can be limited to regions of interest. Current video , output 
" graphics card transmit the entire contents of the frame-buffer at a rate 
such as 75 Hz independent of the portions of the frame-buffer that have been modified. Since the 
SapWcs adapter renders the pixels into the frame-buffer it should be able to easily keep track of the 
Ss of the changes or tiles or regions that have changed within the frame-buffer very easily. The 
graphics adapter needs to only transmit the regions that have changed. 
. Transmittal of frame-buffer contents or some other region of the graphics adapters loed memory could 
^S^bLd and sent to more than one network attached device. This wou d aUow multiple users 
of a Taphics card to be supported simultaneously with their own session or in a collaborative 

Current video output ports on graphics cards transmit the contents of the frame-buffer out 
thTvideo port to whatever is plugged into it. The contents of the frame-buffer are not tagged and 
transmitted to a destination. This makes it very difficult to support multiple users or multiple display 
devices simultaneously using the same graphics adapter. 
. Lower system cost and higher efficiency can be obtained in comparison to the invention disclosure 
"InTernrShics Appliance" (IGA) or PCI board solution. The IGA is a separate appliance tha grabs 
tto toriu ^franie-buffer at refresh rates and performs many operations on the mcoming pixel stream 
to identify if the current frame has changed and the regions or tiles that have changed. These changes 
cou d te more easily and efficiently tracked by a graphics adapter and could be used to ^tifywhen 
data in the frame-buffer needs to be transmitted and the regions that are required to be transmitted 
AdditionaUy a separate device with it's own frame-buffer memory and electrical components would not 
bVreqSwhichwould further reduce the overall system cost It is also noted that does 
not currently exist within a graphics adapter. The invention disclosure titled 

Anoliance" presents a methodology that would allow the frame-buffer or region of the frame-buffer to 
be s*Ter fhe niwork to a remoTe display based on technologies and approaches currently avad^ 
Th^GA invention could be viewed as a technology that could be used while transitioning from current 
technologies to the approach identified in this invention. 
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• Graphics adapter frame-buffer can be viewed remotely anytime, anyplace, and anywhere with no 
distance limitations. Current video out technologies has distance limitations and cannot be viewed from 
any network-attached device. 

• Graphics Adapter with Frame-Buffer Compression Engine and Network Interface. 

Possible Embodiments 

This section describes possible embodiments of the invention: 

• The frame-buffer compression engine and networking functionality may be implemented in a separate 
chip or chips on the graphics adapter as shown in Figure 1 Variation 1. The frame-buffer compression 
engine and networking functionality may be implemented in a custom ASIC chip, DSP, FPGA or other 
alternative. It may be possible to easily design a graphics board with this type of functionality on it 
without modifying the currently available graphics chips. 

• The frame-buffer compression engine and networking functionality may be implemented as a block or 
blocks within the graphics chip as shown in Figure 2 Variation 2. In this design scenario current 
graphics chips would have to be modified significantly to add this type of functionality. 

• The video and DVI port may be eliminated from the graphics adapter completely as shown in Figure 3 
Variation 3 . This would reduce the cost of the graphics adapter. 

• The PCI or AGP interface may be eliminated from the graphics adapter in which case the graphics 
commands themselves would be received from the network interface as shown in Figure 4 Variation 4. 
However, the network connection would have to be significantly faster than what is currently available. 

• The PCI or AGP interface could be substituted with another type of network interface such as 
Infinniband or Fiber Channel or another type of network technology that may become available. This 
embodiment is not shown in a diagram, but is easily created by substituting in the diagrams everywhere 
where is states PCI or AGP. 

. Graphics Adapter with Frame-Buffer Compression Engine Only: In this embodiment the graphics 
adapter only has the frame-buffer compression engine and does not have a network interface. In this 
embodiment the graphics card compresses the frame-buffer. The compressed frame-buffer would be sent 
back to the host system and transmitted over the network by the host to the client. 
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Network Attached Graphics Adapter 



Frame-Buffer Compression Engine and Network Interface Chip 




Figure 1 Variation 1 




Network Attachable Graphics Adapter 



Network Attachable Graphics Chip 



Standard Graphics Chipset Core 



Frame-Buffer Compression 
Engine 



Network Interface Unit 




Figure 2 Variation 2 
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Network Attachable Graphics Adapter 



Network Attachable Graphics Chip 



Standard Graphics Chipset Core 



Frame-Buffer Compression 
Engine 



Network Interface Unit 




Figure 3 Variation 3 



Network Attachable Graphics Appliance 



Network Attachable Graphics Chip 



Standard Graphics Chipset Core 



Frame-Buffer Compression 
Engine 



Network Interface Unit 




Figure 4 Variation 4 
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